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We consider the problem of utility maximization for small traders 
on incomplete financial markets. As opposed to most of the papers 
dealing with this subject, the investors' trading strategies we allow 
underly constraints described by closed, but not necessarily convex, 
sets. The final wealths obtained by trading under these constraints are 
identified as stochastic processes which usually are supermartingales, 
and even martingales for particular strategies. These strategies are 
seen to be optimal, and the corresponding value functions determined 
simply by the initial values of the supermartingales. We separately 
treat the cases of exponential, power and logarithmic utility. 

Introduction. In this paper we consider a small trader on an incomplete 
financial market who can trade in a finite time interval [0,T] by investing in 
risky stocks and a riskless bond. He aims at maximizing the utility he draws 
from his final wealth measured by some utility function. The trading strate- 
gies he may choose to attain his wealth underly some restriction formalized 
by a constraint. For example, he may be forced not to have a negative num- 
ber of shares or that his investment in risky stocks is not allowed to exceed 
a certain threshold. We will be interested not only in describing the trader's 
optimal utility, but also the strategies which he may follow to reach this 
goal. As opposed to most of the papers dealing so far with the maximization 
of expected utility under constraints, we essentially relax the hypotheses to 
be fulfilled by them. They are formulated as usual by the requirement that 
the strategies take their values in some set, which is supposed to simply 
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be closed instead of convex. We consider three types of utility functions. In 
Section 2 we carry out the calculation of the value function and an optimal 
strategy for exponential utility. In this case, the investor is allowed to have 
an additional liability, and maximizes the utility of its sum with terminal 
wealth. In Section 3 we consider power utility, and in Section 4 the simplest 
one: logarithmic utility. 

The method that we apply in order to obtain value function and optimal 
strategy is simple. We propose to construct a stochastic process R p depend- 
ing on the investor's trading strategy p, and such that its terminal value 
equals the utility of the trader's terminal wealth. As mentioned above, to 
model the constraint, trading strategies are supposed to take their values 
in a closed set. In our market, the absence of completeness is not explicitly 
described by a set of martingale measures equivalent to the historical prob- 
ability. Instead, we choose R p such that for every trading strategy p, R p 
is a super martingale. Moreover, there exists at least one particular trading 
strategy p* such that R p is a martingale. Hereby, the initial value is sup- 
posed to not depend on the strategy. Evidently, the strategy p* related to 
the martingale has to be the optimal one. Then the value function of the 
optimization problem is just given by the initial value of R p . 

Since we work on a Wiener filtration, the powerful tool of backward 
stochastic differential equations (BSDE) is available. It allows the construc- 
tion of the stochastic control process p* , and thus the description of the 
value function in terms of the solution of a BSDE. 

In a related paper, El Karoui and Rouge [7] compute the value function 
and the optimal strategy for exponential utility by means of BSDE, assum- 
ing more restrictively that the strategies be confined to a convex cone. Sekine 
[15] relies on a duality result obtained by Cvitanic and Karatzas [2], also 
describing constraints through convex cones. He studies the maximization 
problem for the exponential and power utility functions, and uses an attain- 
ability condition which solves the primal and dual problems, finally writing 
this condition as a BSDE. In contrast to these papers, we do not use duality, 
and directly characterize the solution of the primal problem. This allows us 
to pass from convex to closed constraints. 

Utility maximization is one of the most frequent problems in financial 
mathematics and has been considered by numerous authors. Here are some 
of the milestones viewed from our perspective of maximization under con- 
straints using the tools of BSDEs. For a complete market, utility maximiza- 
tion has been considered in [9]. Cvitanic and Karatzas [2] prove existence 
and uniqueness of the solution for the utility maximization problem in a 
Brownian filtration constraining strategies to convex sets. There are nu- 
merous papers considering general semimartingales as stock price processes. 
Delbaen et al. [4] give a duality result between the optimal strategy for the 
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maximization of the exponential utility and the martingale measure mini- 
mizing the relative entropy with respect to the real world measure P. This 
duality can be used to characterize the utility indifference price for an op- 
tion. Also relying upon duality theory, Kramkov and Schachermayer [12] 
and Cvitanic, Schachermayer and Wang [3] give a fairly complete solution 
of the utility optimization problem on incomplete markets for a class of 
general utility functions not containing the exponential one. See also the re- 
view paper by Schachermayer [16] for a more complete account and further 
references. 

The powerful tool of BSDE has been introduced to stochastic control the- 
ory by Bismut [1] . Its mathematical treatment in terms of stochastic analysis 
was initiated by Pardoux and Peng [14], and its particular significance for 
the field of utility maximization in financial stochastics clarified in [6]. 

1. Preliminaries and the market model. A probability space (£l,J-,P) 
carrying an m-dimensional Brownian motion (Wt)t^[o,T] is given. The filtra- 
tion F is the completion of the filtration generated by W . 

Let us briefly explain some special notation that will be used in the paper. 
| • | stands for the Euclidean norm in M. m . For q > 1, L q denotes the set 
of ^p-measurable random variables F such that -Efl-Fl 9 ] < oo, for k £ N, 
H k {R d ) the set of all Revalued stochastic processes $ which are predictable 
with respect to F and satisfy E[Jq \d t \ k dt] < oo. H°°(]R d ) is the set of all 
F-predictable Revalued processes that are A®P-a.e. bounded on [0,T] x Q. 
Note here that we write A for the Lebesgue measure on [0,T] or 1. 

Let M denote a continuous semimartingale. The stochastic exponential 
£(M) is given by 

S(M) t = exp(M t - \{M) t ), t € [0,T], 

where the quadratic variation is denoted by (M). Let C denote a closed 
subset of W 71 and a £ W 71 . The distance between a and C is defined as 

distc(a) = min |a — b\. 
b^C 

The set lie (a) consists of those elements of C at which the minimum is 
obtained: 

U c (a) = {beC:\a-b\ = distc(a)}. 

This set is not empty and evidently may contain more than one point. 

The financial market consists of one bond with interest rate zero and 
d<m stocks. In case d < m, we face an incomplete market. The price process 
of stock i evolves according to the equation 

(1) —t = b\dt + a\dW u i = l,...,d, 
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where b l (resp. a 1 ) is an R- valued (resp. R lxm - valued) predictable uniformly 
bounded stochastic process. The lines of the d x m-matrix a are given by 
the vector cr|, i = 1, . . . , d. The volatility matrix a = (o"*)i=i,...,d has full rank 
and we assume that aa tr is uniformly elliptic, that is, KI^ > aa tr > el^, 
P-&.S. for constants K > e > 0. The predictable M m -valued process 

9 t = a t t r (a t a t t r )- 1 b t , te[0,T], 

is then also uniformly bounded. 

A d-dimensional F-predictable process tt = (irt)o<t<T is called trading 
strategy if / irf- is well defined, for example, J \\irt<Jt || 2 dt < oo P-a.s. For 
1 < i < d, the process tt\ describes the amount of money invested in stock i 
at time t. The number of shares is The wealth process X 77 of a trading 
strategy tt with initial capital x satisfies the equation 

d „t „t 

X? = x + J2 5^ dS iyU = x+ n u a u (dW u + 9 U du), t G [0,T]. 

i=1 J0 ^>i,u J 

In this notation 7r has to be taken as a vector in M lx,i . Trading strategies 
are self-financing. The investor uses his initial capital and during the trading 
interval [0, T] , there is no extra money flow out of or into his portfolio. Gains 
or losses are only obtained by trading with the stock. 

The optimal trading strategy we will find in this paper happens to be in 
the class of martingales of bounded mean oscillation, briefly called BMO- 
martingales. Here we recall a few well-known facts from this theory following 
the exposition in [10]. The statements in [10] are made for infinite time hori- 
zon. In the text they will be applied to the simpler framework of finite time 
horizon, replacing oo with T. Let G be a complete, right-continuous filtra- 
tion, P a probability measure and M a continuous local (P, (G)-martingale 
satisfying Mq = 0. Let 1 < p < oo. Then M is in the normed linear space 
BMOp if 

||M||bmcV= su P E[\M T -M T \ p \g T }yp<oo. 

t G-stopping time 

By Corollary 2.1 in [10], M is a BMO p -martingale if and only if it is a 
BMOg-martingale for every q > 1. Therefore, it is simply called a BMO- 
martingale. In particular, M is a BMO-martingale if and only if 

||M||bmo 3 = sup E[(M) T - (A/) r |g T ] 1/2 <oo. 

r G-stopping time 

This means local martingales of the form Mt = Jq £ s dW s are BMO-martingales 
if and only if 



rT 

(2) ||M||bmo 2 = sup E 

t G-stopping time 



rT 

J \\is\\ 2 ds\Q T 



1/2 

< OO. 
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Due to the finite time horizon, this condition is satisfied for bounded inte- 
grands. According to Theorem 2.3 in [10], the stochastic exponential £(M) of 
a BMO-martingale M is a uniformly integrable martingale. If Q is a prob- 
ability measure defined by dQ = £(M)t dP for a P-BMO martingale M, 
then the Girsanov transform of a P-BMO martingale is a BMO-martingale 
under Q (Theorem 3.6 in [10]). 

Suppose our investor has a liability F at time T. This random variable F 
is assumed to be .^-measurable and bounded, but not necessarily positive. 
He tries to find a trading strategy that is optimal in presence of this liability 
F, in a sense to be made precise in the beginning of the following section. 

In order to compute the optimal trading strategy, we use quadratic Back- 
ward Stochastic Differential Equations (BSDE) and apply a result of Koby- 
lanski [11] to get existence of a solution for our BSDE. This result is proved 
for bounded terminal random variables. Therefore, we have to assume that 
F is bounded. 

2. Exponential utility. In this section we specify the sense of optimality 
for trading strategies by stipulating that the investor wants to maximize his 
expected utility with respect to the exponential utility from his total wealth 
X T — F. Let us recall that, for a > 0, the exponential utility function is 
defined as 

U(x) = — exp(— ax), 

The definition of admissible trading strategies guarantees that there is 
no arbitrage. In addition, we allow constraints on the trading strategies. 
Formally, they are supposed to take their values in a closed set, that is, 
iTt(uj) 6 C, with C C ]R lxd . We emphasize that C is not assumed to be 
convex. 

Definition 1 (Admissible strategies with constraints). Let C be a closed 
set in R lxd . The set of admissible trading strategies A consists of all d- 
dimensional predictable processes 7r = (vr t )o<t<T which satisfy E[Jq 1 7r t cr t | 2 dt] < 
oo and irt € C X<S) P-a.s., as well as 

{exp(— aX^) :t stopping time with values in [0,T]} 

is a uniformly integrable family. 

Remark 2 . The condition of square integrability in Definition 1 guaran- 
tees that there is no arbitrage. In fact, the square integrability condition on 
7r and the boundedness of 8 yields that £ , [sup 0<t<r (X t 7r ) 2 ] < oo. According 
to Theorem 2.1 in [14], (X t ,irt<Jt) is the unique solution of the BSDE 



Xt = Xt — 
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with E[Jq(X^) 2 (Is] < oo, E[Jq \ir s a s ) 2 ds] < oo. So the initial capital Xfi 
needed to attain Xj- is uniquely determined. In particular, Theorem 2.2 
in [6] yields if Xfi = and X^ > P-a.s., then X^ = P-a.s. 

Remark 3. In accordance with the classical literature (see [5]) the uni- 
form integrability condition in Definition 1 coincides with the notion of class 
D. 

Remark 4. If X n is square integrable and Tr t G C A <8> P well as 

X 1 is bounded from below on [0, T], it is obvious that n G A. 

For t £ [0,T],uj G define the set C t (w) C M m by 

(3) C t (w) = C<7 t (a;). 

The entries of the matrix-valued process <r are uniformly bounded. There- 
fore, we get 

(4) min{|a| : a G Ct(co)} < k± for A <8> P-a,.e.(t,u) 

with a constant k\ > 0. Furthermore, for every (o>, i), the set Ct{u)) is closed. 
This is crucial for our analysis. 

Remark 5. Writing 

Pt = nvt, te[o,T], 

the set of admissible trading strategies A is equivalent to a set A of K lxm - valued 
predictable stochastic processes p with p G A iff £[/ b0)| 2 (ii] < oo and 
Pt(w) G Ct{oj) P-a.s., as well as 

{exp(— aX^) :t stopping time with values in [0, T]} 

is a uniformly integrable family. 

Such a process p G A will also be named strategy, and X^ denotes its 
wealth process. 

So the investor wants to solve the maximization problem 



V(x) := sup E 



Of 



where x is the initial wealth. V is called value function. Losses, that is, 
realizations with X w — F < 0, are punished very strongly. Large gains or 
realizations with X 71 — F > are weakly valued. 
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Remark 6. We shall show below that the sup is taken by a particular 
strategy p* which is admissible in the sense of our definition. Note that this 
process might not lead to a wealth process which is bounded from below, and 
therefore not admissible in this sense. For further details, see [13] and [17]. 

The maximization problem is evidently equivalent to 

(5) V(x)=supE 



■exp(-a(x + J p t {dW t + e t dt)-F 



In order to find the value function and an optimal strategy, we construct a 
family of stochastic processes with the following properties: 

• = - eX p(-a(X£ - F)) for all p G A, 

(p) 

• Rn = Ro is constant for all p G A, 

• R^ is a supermartingale for all p G A and there exists a p* G A such that 

is a martingale. 

The process R^ and its initial value Ro depend, of course, on the initial 
capital x. Given processes possessing these properties, we can compare the 
expected utilities of the strategies p G A and p* G A by 

(6) E[- exp(-a(X£ - F))] < R {x) = E[-exp(-a(x£ - F))] = V(x), 

whence p* is the desired optimal strategy. To construct this family, we set 

R[ p) := -exp(-a(X i (p) - Y t )), t G [0,T],p G A, 

where (Y, Z) is a solution of the BSDE 

Y t = F- J T Z s dW s - ^ f(s, Z s ) ds, t G [0, T). 



In these terms we are bound to choose a function / for which R^ is a 
supermartingale for all p G A and there exists a p* G A such that R( p *^ is a 
martingale. This function / also depends on the constraint set (Ct), where 
(pt) takes its values [see (3)]. We get 

V(x) = R ( Q p ' x) = - exp(-a(x - Y j) for all p G A. 

In order to calculate /, we write R as the product of a (local) martingale 
and a (not strictly) decreasing process I" that is constant for some 
p* G A. For t G [0,T], define 



= exp(-Q( 3 ; - Y )) exp (- J* a( Ps - Z s ) dW s - \ J a 2 (p s - Z s ) 



2 ds 
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Comparing and M^A& yields 



r(p) 



expl / v(s,p s ,Z s )ds), ie[0,T] 



with 



-ap6>< + a/(t, z) + |a 2 |p — z\ 2 . 



V(t,p,z) - ^y„ t , „j , 2 . 

In order to obtain a decreasing process A&\ evidently / has to satisfy 
v(t,p t ,Z t )>0 for aliped 

and 

v(t,p* t ,Z t ) = 
for some particular p* € A. For t € [0, T], we have 



1 



a 



v(t,p t ,Z t ) 



\pt\ -ap t [Z t + 



Pt 



Pt 



Z t + -0 t 

a 



Z t + -B t 

a 



h 

a 

2 



+ ^\Z t \ 2 + f(t,Z t ) 



z t + -o t 

a 



a 



±^Z? + f(t,Z t 



2 -z t et-^\e t \ 2 + f(t,Zt). 

2a 



Now set 



f(t,z) 



dist 2 fz + -0 t ,Ct(u)) +z9 t + ^-\e t \ 2 . 
\ a J 2a 



For this choice, we get v(t,p,z) > and for 

1 



Pt G n CtH [ z t + -bt , 



te[0,T], 



we obtain v(-,p*,Z) =0. 

Here we see why the set C and, hence, C% on which trading strategies 
are restricted is assumed to be closed. In order to find the value function, 
we have to minimize the distance between a point and a set. Furthermore, 
there must exist some element in Ct realizing the minimal distance. Both 
requirements are satisfied for closed sets. In a convex set the minimizer 
is unique. This would lead to a unique utility maximizing trading strategy. 
However, we prove existence of a possibly nonunique trading strategy solving 
the maximization problem for closed but not necessarily convex constraints. 



by 



Theorem 7. The value function of the optimization problem (5) is given 



V(x) 



exp(-a(x - Y )), 
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where Y is defined by the unique solution (Y,Z) G H°°(M) x 7i 2 (M m ) of the 
BSDE 

(7) Y t = F- [ T Z s dW s - [ T f(s,Z s )ds, t€[0,T\, 

Jt Jt 



with 



f(;Z) = ~ dist 2 (z + -6, C) + Z0 + -L| 
2 \ a J 2a 



There exists an optimal trading strategy p* G A, with 

(8) p?en CtM (z t + ~0 t ), te[0,T},P-a.s. 

Proof. In order to get the existence of solutions of the BSDE (7), we 
apply Theorem 2.3 of [11]. According to Lemma 11 below, for fixed z G M m , 
(f{t, -z))t6[o,T] defines a predictable process. A sufficient condition for the 
existence of a solution is condition (HI) in [11]: there are constants cq,c\ 
such that 

(9) |/(M)I <cq + ci\z\ 2 for all z G M n P-a.s. 
By means of (4), we get, for z G M m , t G [0, T], 

dist 2 (z + -6t,C t ) < 2\z\ 2 + 2 (-\9 t \ + fci 
V a / \a 

So (9) follows from the boundedness of 9. Theorem 2.3 in [11] states that 
the BSDE (7) possesses at least one solution (Y,Z) G H°°{R) x H 2 (R m ). 

To prove uniqueness, suppose that solutions (Y 1 , Z 1 ) G W°°(R) x H 2 (R m ), 
(Y 2 , Z 2 ) G W°°(R) x H 2 (W n ) of the BSDE are given. Then we have 

Y 1 — Y 2 = — ^(Z 1 - Z 2 ) dW - J T (f(s, Z\) - f(s, Z 2 ))ds. 

Now note that, for s G [0, T],z , z G R m , we may write 
f{s,z l )-f{s,z 2 ) 

1 \ / 1 \ 1 

+ C* 1 



dist 2 z 1 + -0 S) C s - dist 2 z 2 + -0 SJ C. 
a J \ a 



z 2 ) 



Using the Lipschitz property of the distance function from a closed set, we 
obtain the estimate 

l/^z 1 ) - f(s,z 2 )\ < c x \z x - z 2 \ +c 2 (l^l + \z 2 \){\z x - z 2 \) 
< c 3 (l + \z l \ + \z 2 \)\z 1 -z 2 \. 
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Let us set 

f f(t,Z})-f(t,Z 2 ) 

[ o, if z\ - Z 2 = 0. 

Then we obtain from the preceding estimate 

\m\<<l + \Zl\ + \zf\), te[0,T]. 

Moreover, from the boundedness of Y 1 and Y 2 , the P-BMO property of 
J 'Z'(s)(ilf s , i = 1,2, follows, see Lemma 12. This in turn entails that 
/q (3{s) dW s is a P-BMO martingale. But this allows us to give an alter- 
native description of the difference of solutions in 

Y l - Y 2 = - J T (Z] - Z 2 S ) dW s - J T (3(s)(Zl - Z 2 S ) ds 

T 



(Z 1 s -Z 2 )[dW s + P(s)ds}. 



This process is a martingale under the equivalent probability measure Q, 
which has density 

rT 

"*>t 



s(-j P(t)dW t 



with respect to P. Since Yj, = F = Y£, we therefore conclude y 1 = Y 2 and 
Z 1 = Z 2 , and uniqueness is established. 

To find the value function of our optimization problem, we proceed with 
the unique solution (Y, Z) G H°°(M) x H 2 (W m ) of (7). Let p* denote the pre- 
dictable process constructed in Lemma 11 for a = Z + ^6. Then A[ p \oj) = 
— 1 for A ® P almost all (t,uj). By Lemma 12 below, J (p* s — Z s )dW s is a 
P-BMO martingale, whence Pj p *) is uniformly integrable (Theorem 2.3 in 
[10]). Since, moreover, Y is a bounded process, we obtain the uniform inte- 
grability of the family {exp(— aXi P ^) : r stopping time in [0, T]}. Therefore, 
p* € ^4. Hence, R(p*> x ) is a martingale and 



Pf } = E 



■ex.p(^-a(x + J p*(dW s + 6 S ds) — F 
exp(— a(x — Yq)). 



It remains to show that is a super martingale for all p S A. Since p G A, 
the process M = Mo£(—a j (p s — Z s ) dW s ) is a local martingale. Hence, there 
exists a sequence of stopping times (r n ) nS N satisfying linin^oo r n = T P-a.s. 
such that (Mt/\ Tn )t is a positive martingale for each n G N. The process 
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(p) ~(p) 

is decreasing. Thus, R^ T = M t /\ Tn A t }( Tn is a super martingale, that is, for 
s<t, 

E [R$\tJFs] < RsAr n - 

For any set A 6 T s , we have 

E[RS Tn l A ]<E[R^ Tn t A }. 

Since {R$ T } n and {-R^ Tn }n ar e uniformly integrable by the definition of 
admissibility and the boundedness of Y, we may let n tend to co to obtain 

E[Rph A ]<E[R<fh A }. 
This implies the claimed supermartingale property of R^\ □ 

Remark 8. If the process / " p s dW s is a BMO martingale and £"[exp x (— a 
F))] < oo, a variant of an argument of the above proof can be used to see 
that p € A. In fact, we see that AfW is a uniformly integrable martingale, 
while A^ is decreasing. Hence, R^ is a supermartingale. This just states 
that, for stopping times r, 

-exp(-a(X^ -Y T )) > exp(-a(X^ ) -F))|^ T ]. 

Consequently, 

exp(-aA^) < exp(-ay T )^[exp(-a(X^ ) - F))|jF r ]. 

This clearly implies uniform integrability of {exp(— aX^) :r stopping time 
in [0,T]}. 

We can show that the strategy p* is optimal in a wider sense. In fact, an 
investor who has chosen at time the strategy p* will stick to this decision 
if he starts solving the optimization problem at some later time between 
and T. For this purpose, let us formulate the optimization problem more 
generally for a stopping time r < T and an .F T -measurable random variable 
which describes the capital at time r, that is, X T = X^ for some p € A. So 
we consider the maximization problem 



V(t,X t ) = ess sup E 

(10) 



rT 



■exp(-a(x T + J Ps (dW s + 9 s ds)-F 



Proposition 9 (Dynamic principle). The value function x i— > — exp(— a(x 
y)) satisfies the dynamic programming principle, that is, 

V(T,X T ) = -eM-a(X T -Y T )) 
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for all stopping times t <T , where Y T belongs to a solution of the BSDE 
(7). An optimal strategy that attains the essential supremum in (10) is given 
by p* , the optimal strategy constructed in Theorem 7. 

Proof. For t G [0,T], set 

Rt = -exp(-a(X t -Y t ))£ (- jf a(p s - Z s )dW^j ex p(J t v ( s ,Ps, Z s ) ds^ 

and apply the optional stopping theorem to the stochastic exponential. The 
claim follows as in Theorem 7. □ 

Remark 10. If the constraint C on the strategies is a convex cone, the 
value function V and the optimal strategy p* both constructed in Theorem 7 
are equivalent to those determined in [15] and [7]. 

Sekine considers the utility function x i— > — ^exp(— ax). He obtains the 
value function 

V(x) = exp(— ax + Yq), 

a 

starting with the BSDE 

% = aF - [ T z s dW s - [ T f(s, 6 s ,z s ) ds, t G [0, T], 
Jt Jt 

where 

f(t, o u z) = e t u Ct {z + e t )-\\z- u Ct (z + e t )\ 2 . 

We evidently have to show that Yf = aYt for t G [0,T] or, equivalently, 
af(t,6t, ^) = f(t,6t,z). Note that for a convex set C, the projection lie (a) 
is unique. If C is a convex cone and f3 > 0, then /311c (a) = lie (/3a). The 
equality for the functions / and / therefore follows. El Karoui and Rouge 
[7] have obtained the same BSDE and value function before Sekine. 

In the following lemma we return to a technical point in the proof of 
Theorem 7. We show that it is possible to define a predictable process which 
satisfies (8). Instead of referring to a classical section theorem, see [5], we 
prefer to give a direct and constructive proof. 

Lemma 11 (Measurable selection). Let (at)te[o,T\i ( <J t)tG[o,T] ^ e K lxm - 
valued (resp. W 1 *™ -valued ) predictable stochastic processes, CcR d a closed 
set and C t = Ca t ,te [0,T]. 

(a) The process 

d = (dvst(at,Ca t ))te[o,T\ 

is predictable. 
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(b) There exists a predictable process a* with 

a? € lift (at) for allt 6 [0,T]. 

Proof. In order to prove (a), observe that d is the composition of con- 
tinuous mappings with predictable processes. For fcGN, let H k denote the 
space of compact subsets of R fc equipped with the Hausdorff metric and 
B{H k ) the Borel sigma algebra with respect to this metric. The mapping 
dist :R m x H m — > R is jointly continuous, hence, (B(R m ) <g> B{H m ) - £>(R))- 
measurable. Now consider j : R rfxm x H d — > H m that maps a compact subset 
C in R d by applying a (d x m)-matrix a to a compact subset if of R m . More 
formally, j maps C to the following set: 

K = {beR m \3ceC:b = ca}. 

The mapping j is also jointly continuous and, therefore, (B(W nxd )®B(H d ) — 
£>(if m )) -measurable. Hence, (a) follows for compact C. 

If more generally C is closed but not bounded, take C n = C n B n , where 
B n is the closed ball with radius n centered at the origin. According to 
what has already been shown, for n € N, dist(at,C n o~t) defines a predictable 
process and dist (at, C n o~t) converges to dist (at, Cat), for n — > oo. This proves 
the first claim. 

In order to prove the second claim, we first concentrate on the case of 
compact C. We have to show that, for z 6 R m and a compact set K C M m , 
there exists a (B(M. m ) ® B(H m ) — £>(R m ))-measurable mapping £(z, K) with 
£ (z, G 11^- (2) . This is achieved by the definition of a sequence of mappings 
£ n (z, K) with a subsequence of randomly chosen index that converges to an 
element of 11^ (z). The choice of the converging subsequence will depend in 
a measurable way on z and K. 

For n € N, let G n = (xf)i^ be a dyadic grid with min^g^ dist(f, x) < - 
for all z € R m . Let the elements of the grid G n be numbered by G n = {gf : i 6 
N}. Let K n be the elements of the grid with distance at most - from G n . 
Since we can describe the sets K n as the intersections of the discrete set G n 
with the closed set of all points in R m having distance at most ^ from K, 
and this closed set depends continuously on K, K n is measurable in K. For 
any z £ R m , let H n (z, K) be the set of all points in K n with minimal distance 
from z. Since K n is measurable in K, H n (z,K) is obviously measurable in 
(z, K). To define Cn(z, K), we have to choose one point in H n (z, K). Let it be 
the one with minimal index in the enumeration of G n . This choice preserves 
the measurability in (z,K). Hence, we obtain that £ n (z,K) is (i3(R m ) (8) 
B(H m ) — BiW 171 ) )-measurable. Furthermore, liminL^^oo \£ n (z,K)\ < 00 for 
all (z, K). This is one assumption in Lemma 1.55 in [8] that we aim to apply. 
This lemma is stated for equivalence classes of random variables, where two 
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random variables are equivalent if they are equal almost everywhere with 
respect to a probability measure. Considering carefully the proof, we see 
that we can apply this lemma, also without reference to any measure, to 
obtain a result for every (z, K) G M' m x H m . 

Lemma 1.55 in [8] yields a strictly increasing sequence (r n ) n€ N of inte- 
ger valued, (B(M. m ) ® B(H rn ) — £>(IR))-measurable functions and a mapping 
£ : K m x H m — ► M m measurable with respect to the corresponding product 
cr-algebra, satisfying 

^Jr n{z ,K)^ K) = C(z, K) Vz G W», K G H™. 

But £ is a selection. Indeed, for every n G N, 

|dist(z,£ Tn (z,if)) " dist(z,i?)| < — < -. 

T n n 

Since £ T:o converges to £, we obtain dist(£, if) = 0, hence, £ G if and dist(z, £) = 
dist(z,if). Thus, by construction, £(2,if) G %(^) for all (z,K) G M m x # m . 
We may then choose 

a* =£(a,Ca) 

to satisfy the requirements of the second part of the assertion in the compact 
case. 

Finally, if C is only closed, we may proceed similarly as in the proof for 
(a). Let a™ = £(a, (C fl B n )at), t G [0, T]. This time we apply Lemma 1.55 
in [8] to the sequence of predictable processes (a ?l ) ne N and the measure 
P <S) A on f2 x [0, T]. We obtain a strictly increasing sequence of random 
indices f n (u,t) measurable with respect to the predictable cr-algebra and a 
predictable process a such that 

lim aZ n{u,t) (u) = ot(w) for P ® A a.e. (w, 

n — >oo 

For the process o, we have dist(at,Cat) = P <g) A a.e. □ 

Lemma 12. Let (Y,Z) G W°°(K) x H 2 {M. m ) be a solution of the BSDE 
(7), and let p* be given by Lemma 11 for a = Z + —6. Then the processes 



[ Z s dW s , f P * s dW s 
Jo Jo 



are P-BMO martingales. 

Proof. Let k denote the upper bound of the uniformly bounded process 
Y . Applying Ito's formula to (Y — k) 2 , we obtain, for stopping times r < T, 

rT 



E 



Z 2 ds 



E[(F — k) \T T \ - \Y T -k[ 



2E 



J (Y s -k)f(s,Z s )ds 
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The definition of / yields, for all (t,z) € [0,T] x R m , 

f(t,z)<z6 t + ^-\d t \ 2 . 

2a 

Therefore, there exist positive constants c%, c 2 and c\ such that 



E 



I Z.. I ds 



Ft 



< Cl + C 2 E 

< ci + \E 



T 



\Z S + 1| ds 



V T 

T 



\ZA 2 ds 



Hence, / " Z s dW s is a BMO martingale. 

We next deal with the stochastic integral process of p*. The triangle in- 
equality implies 











< 


z + -e 


+ 






a 







The definition of p* together with (4) , yields for some constants k\, k 2 , 

\p* t \ < 2\Z t \ + — + fci < 2|Zt| + k 2 , tE [0,T], 
a 

and, thus, for every stopping time r < T, 



E 



T 



\p*t\ Z dt 



<E 



rT 

J 8\Z t \ 2 dt + 2Tkj 



Ft 



This implies the P-BMO property of ^p*dW s . □ 



3. Power utility. In this section we calculate the value function and char- 
acterize the optimal strategy for the utility maximization problem with re- 
spect to 

UJx) = -x 1 , x>0, 7 6(0,1). 

7 

This time, our investor maximizes the expected utility of his wealth at time 
T without an additional liability. The trading strategies are constrained to 
take values in a closed set C 2 Q In this section we shall use a somewhat 
different notion of trading strategy: p = (p ? )j=i ... d denotes the part of the 

wealth invested in stock i. The number of shares of stock i is given by A 

(i-dimensional F-predictable process p = (pt)o<t<T is called trading strategy 
(part of wealth) if the following wealth process is well defined: 



(11) x\ 



(p) 



+ / £ o ,S dS i!S = x+ I X^p s a s (dW s + 9 s ds), 



i=i 



Si. 
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and the initial capital x is positive. The wealth process can be written 

as 

X ( / ] =x£^J p s a s (dW s + 6 s ds)j , t€[0,T\. 

As before, it is more convenient to introduce 

Pt = Ptou te[0,T]. 

Accordingly, p is constrained to take its values in 

C t (u) = Ca t (u), tG[0,T],wen. 

The sets Ct satisfy (4). In order to formulate the optimization problem, we 
first define the set of admissible trading strategies. 

Definition 13. The set of admissible trading strategies A consists of all 
ci-dimensional predictable processes p = (pt)o<t<T that satisfy pt £ Ct(cu)P ® A-a.s. 
and Jq \p s \ 2 ds < oo P-a.s. 

Define the probability measure Q ~ P by 

The set of admissible trading strategies is free of arbitrage because, for every 
peA, the wealth process is a local Q-martingale bounded from below, 
hence, a Q-supermartingale. Since Q is equivalent to P, the set of trading 
strategies A is free of arbitrage. 

The investor faces the maximization problem 

(12) V{x) = supE[U(x!f ) )]. 

In order to find the value function and an optimal strategy, we apply the 
same method as for the exponential utility function. We therefore have to 
construct a stochastic process PS P ^ with terminal value 

and an initial value Rq = Rq that does not depend on p, is a su- 
permartingale for all p £ A and a martingale for a p* £ A- Then p* is the 
optimal strategy and the value function given by V(x) = Rq. Applying the 
utility function to the wealth process yields 

(AfT = x< exp QT* 1Ps dW s + J* 1Ps e s ds-\ J\\p s \ 2 d^j, t 6 [0,T]. 
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This equation suggests the following choice: 

(13) R\ p) = x~< exp (J 1Ps dW s + J* 1Ps e s ds-\ J\\p s \ 2 ds + Y t 
where (Y, Z) is a solution of the BSDE 



Y t = 0- ( T Z s dW s - I' f(s,Z s )ds, tE[0,T}. 
Jt Jt 

In order to get the supermartingale property of BS P \ we have to construct 
f(t,z) such that, for t G [0, T], 

(14) lpt e t -\ 1 \p t \ 2 + f(t,Z t )<-\\ 1Pt + Z t \ 2 for all peA. 

will even be a martingale if equality holds for p* G A. This is equivalent 

to 

l 7 |Z t + ^| 2 1 



/(t,Z t )<i 7 (l- 7 ) 



P t--^—{z t + e t 

1-7 



1-7 



\Zt\ 2 - 



Hence, the appropriate choice for / is 

f{t, z) = dist 2 (^-(z + e t ),c t ) - ^4 --\ z \ 2 , 

j\i ) 2 Vl -7 J 2(1-7) 2 1 1 ' 

and a candidate for the optimal strategy must satisfy 

pi e n Ct(£j) (^(^ + . * e [0, T]. 

In the following theorem both value function and optimal strategy are de- 
scribed. 

Theorem 14. The value function of the optimization problem is given 

by 

V(x) = x 1 exp(Yo) for x > 0, 

where Y is defined by the unique solution (Y,Z) G 7i°°(M) x 7i 2 (M m ) of the 
BSDE 

(15) Y t = 0- £ Z s dW s - J f(s,Z s )ds, te[0,T], 

with 

/(t ,^2<Lp) di8 ,(_i_ (2+( , t) , Cl )_^_i N2 



There exists an optimal trading strategy p* G A with the property 

1 



(16) rf€n c , M (-i-(z,+« 
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Proof. According to Lemma 11, (f(t, z))t£[o,r] is a predictable stochas- 
tic process which also depends on a. Due to (4) and the boundedness of 9, 
Condition (HI) for Theorem 2.3 in [11] is fulfilled. We obtain the existence 
of a solution (Y,Z) £ H°°(R) x H 2 (R m ) for the BSDE (15). Uniqueness fol- 
lows from the comparison arguments in the uniqueness part of the proof of 
Theorem 7. 

Let p* denote the predictable process constructed with Lemma 11 for 
a = jz^{Z + 6). Lemma 17 below shows that p* £ A. By Theorem 2.3 in 

[10], the process is a martingale with terminal value 

R { f ) = x 1 exp (J^ 1P * S dW s + £ jp* s 6 s ds-\ J%\p* s \ 2 ds 

This is the power utility from terminal wealth of the trading strategy p*. 
Therefore, the expected utility of p* is equal to Rq P = £ 7 exp(Yo)- 
To show that this provides the value function, let p £ A. (14) yields 

R\ p) = ^ exp(y )£ ( 1Ps + Z s ) dW^j ^ exp Qf v. ds) , t€ [0, T], 

for a process v with v s < A <8> P-a.s. 

The stochastic exponential is a local martingale. There exists a sequence 
of stopping times (r n ) nG N, linin^ooTn = T such that 

E[Ru\ Tn \^s]< R^Am > S<t, 

for every n € N. Furthermore, R^ is bounded from below by 0. Passing to 
the limit and applying Fatou's lemma yields that R^ is a supermartingale. 
The terminal value R^' x ^ is the utility of the terminal wealth of the trading 
strategy p. Consequently, 

E[U(X^' x) )} < R { x) = x 7 exp(y ) for all p 6 A. □ 

Again, we can show that an investor starting to act at some stopping time 
in the trading interval [0, T] will perceive the strategy p* just constructed 
as optimal. Let r < T denote a stopping time and X T an T T - measurable 
random variable which describes the capital at time r, that is, X T = X? for 
a p € A and an initial capital x > 0. Consider the maximization problem 



(17) V(t,X t ) = ess sup £ 

P&At 



U (yX T + £ X sPs {dWs + 9 S ds) ) 



Proposition 15 (Dynamic principle). The value function x 7 exp(y) 
satisfies the dynamic programming principle, that is, 

V(T,X T ) = (X T yexp(Y T ) 
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for all stopping times t <T, where Y T is given by the unique solution (Y, Z) 
of the BSDE (15). An optimal strategy which attains the essential supremum 
in (17) is given by p* constructed in Theorem 14. 

Proof. See Proposition 9. 

Remark 16. Suppose that the constraint set C is a convex cone. Then 
the optimal strategy p* constructed in Theorem 14 is the same as in [15]. 

Sekine uses the utility function x i— > ^x 7 and obtains the value function 

y(x) = -x 7 exp((l- 7 )Yo), 

7 

where Y is defined by the unique solution (Y, Z) € H°°(R) x H 2 (W m ) of the 
BSDE 



Here 



Y t = 



1 



Z s dW s 



e t -u Ct [z + 



g(s,Z s )ds, te[0,T}. 



1-7 



1-7 



z-n Ct [z + 



1-7 



As for the exponential utility function, we have to show (1 — j)Y = Y or, 
equivalently, (1 — "f)g(t, jz^r) = f(t, z). In fact, we have 



(1-7)9* 



1-7 



-7) 




2 1 


2 


2 


(1- 


7) 2 


z 


2 


1-7 



0*-n. 



n 



c, 



1-7 
2 + 0* 



^n Ct (z + ^) 



i 



2(1-7) 



'Vl-7 



|n Ct (2 + ^ 



i 



- -\z\ A + zU Ct (z + B t ) - -|n Ct (z + o t ) 



(z + e t )n Ct (z + e t 

7 



, \n Ct (z + <9f)r - 

2(1-7)' 2' ' 



-^L-\n Ct (z + e t )\ 2 --\z\ 2 
2(1-7)' 2' ' 

1. ,0 



To obtain the last equality, we use 



(z + e t )u Ct (z + e t ) = \u Ct (z + e t 
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[see (18) below]. 

For the function /, we obtain 




( z + e t )-u Ct 



(i^<* + *>) 



l (z + 0t? 1 
2 (l- 7 ) 2 



2 



7 



(z + e t )n Ct (z + e t ) + 



7 



\U Ct (z + 6 t )\ 2 --\z 



1-7 



2(1-7) 




For t € [0,T],z£ M m , we therefore have 



(l-7)g(t,y3^) = 



f(.t,z). 



It remains to prove that, for a convex cone C and a G R m , the following 
equality holds: 



If Hc(a) = 0, then the identity is satisfied. If not, consider the half line 
Allc(a), A > 0. This half line is part of the cone C, so lie* (a) is also the 
projection of a on the half line. □ 



Lemma 17. Let (Y,Z) G H°°(R) x H 2 (W m ) be a solution of the BSDE 
(15), and let p* be given by (16). Then the processes 



are P-BMO martingales. 

Proof. We can use the same line of reasoning as in the proof of Lemma 12. 
The argument given there has to be slightly modified, however. We may take 
a lower bound k for Y, and apply Ito's formula to \Y — k\ 2 , to conclude in 
the same manner as before. □ 

4. Log utility. To complete the spectrum of important utility functions, 
in this section we shall consider logarithmic utility. As in the preceding 
section, the agent has no liability at time T. Trading strategies and wealth 
process have the same meaning as in Section 3 [see (11)]. The trading strate- 
gies p are constrained to take values in a closed set Ci C For pt = fito~t, 
the constraints are described by Ct = C20t, t 6 [0, T] . In order to compare the 



(18) 



n c (a)(a-n c (a)) = 0. 
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logarithmic utility of the terminal wealth of two trading strategies, we have 
to impose a mild integrability condition on p. Recall that p % > 1 means that 
the investor has to borrow money in order to buy stock i and if p % < 0, then 
the investor has a negative number of stock i. An integrability condition on 
p is not restrictive. 

Definition 18. The set of admissible trading strategies Ai consists of 
all M d - valued predictable processes p satisfying E[Jq \p s \ 2 ds] < oo and pt € 
C t P®X-a.s. 

For the logarithmic utility function, 

U(x) = log(x), x > 0, 

we obtain a particularly simple BSDE that leads to the value function and 
the optimal strategy. The optimization problem is given by 



/ p s dW s + / (p s e s - \\p s \ 2 )ds 
Jo Jo 



V(x) = snp E[log{X^ p) ] 

(19) 

= log(x) + sup E 
peAi 

where the initial capital x is positive again. As in Section 2, we want to 
determine a process with = log(X^), and an initial value that 
does not depend on p. Furthermore, R^ is a super martingale for all p G Ai, 
and there exists a p* £ Ai such that R^ p *^ is a martingale. The strategy p* 
is the optimal strategy and Rq is the value function of the optimization 
problem (19). 

We can choose, for t € [0, T], 

R ( t p) = logx + Y + [\p s + Z s )dW s + [\-±\p s -6 s \ 2 + ±6 2 + f(s))ds, 
Jo Jo 

where 

f(t) = ±di S t 2 (9 t ,C t )-±\8 t \ 2 , te[0,T], 
and (If, Zi) is the unique solution of the following BSDE: 

Y t = 0- ^ Z s dW s - J T f(s)ds, te[0,T\. 

Due to Definition 18, the boundedness of 9 and (4), the stochastic integral 
m is a martingale for all p £ Ai- Hence, R^ is a supermartingale for 
all p € A[. An optimal trading strategy p* which satisfies /?* £ Hc t (0t), can 
be constructed by means of Lemma 11. The initial value Yq satisfies 

r rT 



Y n = -E 



o 



f(s)ds 
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Hence, 

V(x) = R p *(x)=log(x)+E 

In particular, p* only depends on 6, a and the set C2 describing the con- 
straints on the trading strategies. 
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